Method for controlling multi-field of view image and electronic device for supporting the same

ABSTRACT

An electronic device is provided. The electronic device includes a memory configured to store an image of a multi-field of view (multi-FOV) including an image of a first FOV and an image of a second FOV, a display configured to output the image of the multi-FOV, and a processor configured to be electrically connected with the memory and the display. The process is configured to control to output the image of the first FOV on the display, verify at least one event which meets a condition from the image of the second FOV, and control to provide a notification corresponding to the event in connection with the image of the first FOV, the image being output on the display.

CROSS-REFERENCE TO RELATED APPLICATION(S)

This application claims the benefit under 35 U.S.C. § 119(a) of a Koreanpatent application filed on Aug. 17, 2016 in the Korean IntellectualProperty Office and assigned Serial number 10-2016-0104516, the entiredisclosure of which is hereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to a method for controlling a multi-fieldof view (multi-FOV) image and an electronic device for supporting thesame.

BACKGROUND

Recently, with the rapid spread of commercialization of high-performanceimage display devices such as head mounted displays (HMDs), an interestand demand for three-dimensional (3D) content has been increased. Inresponse to this, there is a need for a platform for viewing amulti-field of view (multi-FOV) image which becomes a key foundation of3D content under a more optimized environment.

The above information is presented as background information only toassist with an understanding of the present disclosure. No determinationhas been made, and no assertion is made, as to whether any of the abovemight be applicable as prior art with regard to the present disclosure.

SUMMARY

A multi-field of view (multi-FOV) image may correspond to athree-dimensional (3D) spherical object. Compared with this, since anelectronic device which plays back a multi-FOV image has a display of alimited size or area, a separate user operation for changing an FOV maybe required to view the multi-FOV image through the electronic device.Thus, inconvenience may be caused during viewing of a multi-FOV image,and an immersion level in viewing images may be reduced. Alternatively,if a user operation associated with changing an FOV is not performed,playback of a multi-FOV image may be limited to a specific FOV and auser may fail to experience events which are generated at the same timeon a multi-FOV image.

Aspects of the present disclosure are to address at least theabove-mentioned problems and/or disadvantages and to provide at leastthe advantages described below. Accordingly, an aspect of the presentdisclosure is to provide a method for providing a multi-FOV image toprovide a notification for at least one event which appears on amulti-FOV image and easily change an FOV of the multi-FOV image based onthe notification and an electronic device for supporting the same.

In accordance with an aspect of the present disclosure, an electronicdevice is provided. The electronic device includes a memory configuredto store an image of a multi-FOV including an image of a first FOV andan image of a second FOV, a display configured to output the image ofthe multi-FOV, and a processor configured to be electrically connectedwith the memory and the display.

According to an embodiment, the process may be configured to control tooutput the image of the first FOV on the display, verify at least oneevent which meets a condition from the image of the second FOV, andcontrol to provide a notification corresponding to the event inconnection with the image of the first FOV, the image being output onthe display.

According to various embodiments, the electronic device may preventimportant events from being missed by easily recognizing events whichappear in different FOVs on a multi-FOV image.

Further, according to various embodiments, the electronic device mayincrease the convenience of viewing of an image by excluding an FOVchange operation for searching for events on a multi-FOV image.

In addition, a variety of effects directly or indirectly ascertainedthrough the present disclosure may be provided.

Other aspects, advantages, and salient features of the disclosure willbecome apparent to those skilled in the art from the following detaileddescription, which, taken in conjunction with the annexed drawings,discloses various embodiments of the present disclosure.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other aspects, features, and advantages of certainembodiments of the present disclosure will be more apparent from thefollowing description taken in conjunction with the accompanyingdrawings, in which:

FIG. 1 is a drawing illustrating an environment in which an electronicdevice is operated, according to an embodiment of the presentdisclosure;

FIG. 2 is a drawing illustrating an example of an environment in which amulti-field of view (multi-FOV) image is played back according to anembodiment of the present disclosure;

FIG. 3 is a block diagram illustrating a configuration of an electronicdevice according to an embodiment of the present disclosure;

FIG. 4 is a drawing illustrating an example of calculating a relativelocation for objects on a multi-FOV image according to an embodiment ofthe present disclosure;

FIG. 5 is a drawing illustrating an image of a first FOV of a multi-FOVaccording to an embodiment of the present disclosure;

FIG. 6 is a drawing illustrating an image of a second FOV of a multi-FOVaccording to an embodiment of the present disclosure;

FIG. 7 is a drawing illustrating an image of a first FOV of a multi-FOVaccording to another embodiment of the present disclosure;

FIG. 8 is a flowchart illustrating a method for controlling a multi-FOVin an electronic device according to an embodiment of the presentdisclosure; and

FIG. 9 is a block diagram illustrating a configuration of an electronicdevice in a network environment according to an embodiment of thepresent disclosure.

Throughout the drawings, it should be noted that like reference numbersare used to depict the same or similar elements, features, andstructures.

DETAILED DESCRIPTION

The following description with reference to the accompanying drawings isprovided to assist in a comprehensive understanding of variousembodiments of the present disclosure as defined by the claims and theirequivalents. It includes various specific details to assist in thatunderstanding but these are to be regarded as merely exemplary.Accordingly, those of ordinary skill in the art will recognize thatvarious changes and modifications of the various embodiments describedherein can be made without departing from the scope and spirit of thepresent disclosure. In addition, descriptions of well-known functionsand constructions may be omitted for clarity and conciseness.

The terms and words used in the following description and claims are notlimited to the bibliographical meanings, but, are merely used by theinventor to enable a clear and consistent understanding of the presentdisclosure. Accordingly, it should be apparent to those skilled in theart that the following description of various embodiments of the presentdisclosure is provided for illustration purpose only and not for thepurpose of limiting the present disclosure as defined by the appendedclaims and their equivalents.

It is to be understood that the singular forms “a,” “an,” and “the”include plural referents unless the context clearly dictates otherwise.Thus, for example, reference to “a component surface” includes referenceto one or more of such surfaces.

The term “include,” “comprise,” and “have”, or “may include,” or “maycomprise” and “may have” used herein indicates disclosed functions,operations, or existence of elements but does not exclude otherfunctions, operations or elements.

For example, the expressions “A or B,” or “at least one of A and/or B”may indicate A and B, A, or B. For instance, the expression “A or B” or“at least one of A and/or B” may indicate (1) at least one A, (2) atleast one B, or (3) both at least one A and at least one B.

The terms such as “1st,” “2nd,” “first,” “second,” and the like usedherein may refer to modifying various different elements of variousembodiments of the present disclosure, but are not intended to limit theelements. For instance, “a first user device” and “a second user device”may indicate different users regardless of order or importance. Forexample, a first component may be referred to as a second component andvice versa without departing from the scope and spirit of the presentdisclosure.

In various embodiments of the present disclosure, it is intended thatwhen a component (for example, a first component) is referred to asbeing “operatively or communicatively coupled with/to” or “connected to”another component (for example a second component), the component may bedirectly connected to the other component or connected through anothercomponent (for example, a third component). In various embodiments ofthe present disclosure, it is intended that when a component (forexample, a first component) is referred to as being “directly connectedto” or “directly accessed” another component (for example, a secondcomponent), another component (for example, a third component) does notexist between the component (for example, the first component) and theother component (for example, the second component).

The expression “configured to” used in various embodiments of thepresent disclosure may be interchangeably used with “suitable for,”“having the capacity to,” “designed to,” “adapted to,” “made to,” or“capable of” according to the situation, for example. The term“configured to” may not necessarily indicate “specifically designed to”in terms of hardware. Instead, the expression “a device configured to”in some situations may indicate that the device and another device orpart are “capable of.” For example, the expression “a processorconfigured to perform A, B, and C” may indicate a dedicated processor(for example, an embedded processor) for performing a correspondingoperation or a general-purpose processor (for example, a centralprocessing unit (CPU) or application processor (AP)) for performingcorresponding operations by executing at least one software programstored in a memory device.

All terms used herein may have the same meanings that are generallyunderstood by a person skilled in the art. In general, terms defined ina dictionary should be considered to have the same meanings as thecontextual meaning of the related art, and, unless clearly definedherein, should not be understood differently or as having an excessivelyformal meaning. In any case, even the terms defined in the presentspecification are not intended to be interpreted as excludingembodiments of the present disclosure.

An electronic device according to various embodiments of the presentdisclosure may include at least one of a smartphone, a tablet personalcomputer (PC), a mobile phone, a video telephone, an electronic bookreader, a desktop PC, a laptop PC, a netbook computer, a workstation, aserver, a personal digital assistant (PDA), a portable multimedia player(PMP), a Motion Picture Experts Group (MPEG-1 or MPEG-2) audio layer 3(MP3) player, a mobile medical device, a camera, or a wearable device.The wearable device may include at least one of an accessory-type device(e.g., a watch, a ring, a bracelet, an anklet, a necklace, glasses, acontact lens, a head-mounted device (HMD)), a textile- orclothing-integrated-type device (e.g., an electronic apparel), abody-attached-type device (e.g., a skin pad or a tattoo), or abio-implantable-type device (e.g., an implantable circuit).

In some various embodiments of the present disclosure, an electronicdevice may be a home appliance. The smart home appliance may include atleast one of, for example, a television (TV), a digital video/versatiledisc (DVD) player, an audio, a refrigerator, an air conditioner, acleaner, an oven, a microwave oven, a washing machine, an air cleaner, aset-top box, a home automation control panel, a security control panel,a television (TV) box (e.g., Samsung HomeSync™, Apple TV™, or GoogleTV™), a game console (e.g., Xbox™ or PlayStation™), an electronicdictionary, an electronic key, a camcorder, or an electronic pictureframe.

In other various embodiments of the present disclosure, an electronicdevice may include at least one of various medical devices (e.g.,various portable medical measurement devices (e.g., a blood glucosemeasuring device, a heart rate measuring device, a blood pressuremeasuring device, a body temperature measuring device, or the like), amagnetic resonance angiography (MRA), a magnetic resonance imaging(MRI), a computed tomography (CT), a scanner, an ultrasonic device, orthe like), a navigation device, a global navigation satellite system(GNSS), an event data recorder (EDR), a flight data recorder (FDR), avehicle infotainment device, electronic equipment for vessels (e.g., anavigation system, a gyrocompass, or the like), avionics, a securitydevice, a head unit for a vehicle, an industrial or home robot, anautomatic teller machine (ATM), a point of sales (POS) device of astore, or an Internet of things (IoT) device (e.g., a light bulb,various sensors, an electric or gas meter, a sprinkler, a fire alarm, athermostat, a streetlamp, a toaster, exercise equipment, a hot watertank, a heater, a boiler, or the like).

According to various embodiments of the present disclosure, anelectronic device may include at least one of a part of furniture or abuilding/structure, an electronic board, an electronic signaturereceiving device, a projector, or a measuring instrument (e.g., a watermeter, an electricity meter, a gas meter, a wave meter, or the like). Anelectronic device may be one or more combinations of the above-mentioneddevices. An electronic device according to some various embodiments ofthe present disclosure may be a flexible device. An electronic deviceaccording to an embodiment of the present disclosure is not limited tothe above-mentioned devices, and may include new electronic devices withthe development of new technology.

Hereinafter, an electronic device according to various embodiments ofthe present disclosure will be described in more detail with referenceto the accompanying drawings. The term “user” used herein may refer to aperson who uses an electronic device or may refer to a device (e.g., anartificial intelligence electronic device) that uses an electronicdevice.

FIG. 1 is a drawing illustrating an environment in which an electronicdevice is operated, according to an embodiment of the presentdisclosure.

Referring to FIG. 1, an electronic device 100 may obtain a multi-fieldof view (multi-FOV) image which may be played back in a plurality ofFOVs from an internal device or various external devices. For example,the electronic device 100 may establish a network with at least one ofan image capture device 1, a flying device 2 for image capture (e.g., adrone), or a server 3 and may perform wired or wireless communicationbased on the network to download (or stream) a program or dataassociated with a multi-FOV image.

The image capture device 1 or the flying device 2 for image capture mayinclude a device or module which may capture a multi-FOV image. Forexample, the image capture device 1 or the flying device 2 for imagecapture may include a plurality of camera modules, each of which has adifferent angle of view. In various embodiments, the image capturedevice 1 or the flying device 2 for image capture may have a function ofediting (e.g., stitching) a plurality of images captured by theplurality of camera modules. Alternatively, the image capture device 1or the flying device 2 for image capture may transmit the plurality ofcaptured images to the server 3 and may request the server 3 to edit aplurality of images.

In various embodiments, the electronic device 100 may be mounted on ahead mounted display (HMD) device 4 to be operated. Alternatively, atleast part of the electronic device 100 may be integrated in the form ofbeing included in the HMD device 4 such that the electronic device 100is operated. Thus, a multi-FOV played back on a display of theelectronic device 100 may be displayed on visibility of a user who wearsthe HMD device 4, and an FOV of an image may be changed in response tomotion or movement of a body (e.g., a head) of the user. In this regard,the HMD device 4 may establish a communication channel with theelectronic device 100 and may process a user input (e.g., a touch inputor motion or movement of the body of the user) associated withcontrolling a multi-FOV image based on the communication channel. Invarious embodiments, the electronic device 100 may be mounted on varioustypes of wearable devices, such as a watch, a bracelet, and a necklace,other than the HMD device 4 to be operated.

An embodiment is exemplified as the image capture device 1, the flyingdevice 2 for image capture, or the server 3 is an external device.However, embodiments are not limited thereto. For example, there may beno limit to an external device which may communicate image data with theelectronic device 100. Further, the electronic device 100 may be theconcept of including the above-mentioned external devices, and theelectronic device 100 itself may be referred to as an external devicewhich captures a multi-FOV image.

FIG. 2 is a drawing illustrating an example of an environment in which amulti-FOV image is played back according to an embodiment of the presentdisclosure.

Referring to FIG. 2, a multi-FOV image captured by an imaging device(e.g., an image capture device 1, a flying device 2 for image capture,or an electronic device 100 of FIG. 1) may include a 360-degreeperipheral region 10 around the imaging device. Compared with this,since a display 120 of the electronic device 100 has a limited displayregion (or a limited output region), only an image corresponding to aspecific FOV (e.g., a first FOV 20) in a multi-FOV image may bedisplayed (or output) on the display 120.

In an embodiment, at least one object 21, 31, and/or 41 which exist onan image capture space may be included in a peripheral region 10associated with a multi-FOV image. The at least one object 31 or 41which appears in an FOV (e.g., a second FOV 30 or a third FOV 40)different from the first FOV 20 may appear at a time different from acurrent playback time 23 of an image of the first FOV 20 on themulti-FOV image. For example, the second object 31 which appears in thesecond FOV 30 may be an object which appears after a time elapses fromthe current playback time 23 of the image of the first FOV 20.Alternatively, the second object 31 of the second FOV 30 may appear atthe same or similar time to the current playback time 23 of the image ofthe first FOV 20. An object, such as the third object 41 (e.g., abuilding) of the third FOV 40, which has immobility (or is not moved) ata specified location, may appear in the third FOV 40 from a time mplayback of the image of the first FOV 20 is started.

As described above, the at least one object 21, 31, and/or 41 may appearin different FOVs or at different times on a multi-FOV image. Thus, if auser operation associated with changing an FOV of a multi-FOV image isnot performed (e.g., if an input signal is not provided to an FOVcontrol interface 25), there may be a limit to an image of a specificFOV (e.g., a first FOV 20) such that a user views the multi-FOV image.Alternatively, although an FOV of a multi-FOV image is changed based onthe FOV control interface 25, since the user does not know informationabout at least one object which appears on the multi-FOV image (e.g.,FOV or time information where a specific object appears), an FOV may bechanged in an impromptu manner. In this case, the user may fail torecognize at least part of the at least one object which appears on themulti-FOV image, or an inconvenient FOV change operation for searchingfor a specific object may be caused.

In an embodiment, the electronic device 100 may display (or output)visual information about at least one object which appears in an FOVdifferent from a specific FOV on at least a partial region of an imageof the specific FOV, displayed (or output) on the display 120. Further,the electronic device 100 may output auditory information or tactileinformation together with displaying the visual information. Theelectronic device 100 may provide a notification for appearance of theat least one object to the user who views a multi-FOV image, based onthe visual information, the auditory information, or the tactileinformation.

FIG. 3 is a block diagram illustrating a configuration of an electronicdevice according to an embodiment of the present disclosure.

Referring to FIG. 3, an electronic device 100 may include a memory 110,a display 120, a communication interface 130, a camera module 140, and aprocessor 150. In various embodiments, the electronic device 100 mayfail to include at least one of the above-mentioned elements or mayfurther include other element(s).

The memory 110 may store at least one program or data associated withoperating an image playback function of the electronic device 100. Forexample, the memory 110 may store at least one multi-FOV imagedownloaded (or streamed) from an external device (e.g., an image capturedevice 1, a flying device 2 for image capture, or a server 3 of FIG, 1).Further, the memory 110 may store a multi-FOV image captured by at leastone image sensor (not shown) included in the camera module 140 or theelectronic device 100.

The display 120 may display (or output) a variety of content (e.g.,text, an image, a video, an icon, a symbol, or the like) in response toa user input signal or specified scheduling information. For example,the display 120 may display at least one multi-FOV image stored in thememory 110 under control of the processor 150 based on the user inputsignal. The display 120 may display an image of one FOV of the multi-FOVimage and may change an image to a different FOV based on control of theprocessor 150, associated with changing an FOV of the image.

The communication interface 130 may support communication between theelectronic device 100 and the external device (e.g., the image capturedevice 1, the flying device 2 for image capture, or the server 3). Forexample, the communication interface 130 may communicate with theexternal device by establishing wired or wireless communicationaccording to a defined protocol with the external device and accessing anetwork based on the wired or wireless communication.

In various embodiments, the electronic device 100 may generate amulti-FOV image itself, other than a multi-FOV image obtained from theexternal device (e.g., the image capture device 1, the flying device 2for image capture, or the server 3). In this regard, the electronicdevice 100 may include the plurality of camera modules 140. Each of theplurality of camera modules 140 may be located in the electronic device100 to have a different angle of view (or have an angle of view, atleast part of which is overlapped). For example, each of the pluralitycamera modules 140 may be located on the electronic device 100 tocapture a region divided every 120 degrees. Alternatively, the pluralityof camera modules 140 may be located at opposite locations on theelectronic device 100 to capture the front and rear of the electronicdevice 100. In various embodiments, the plurality of camera modules 140may be fixed to specified points on the electronic device 100 or may belocated such that at least some of the plurality of camera modules 140are movable in response to a control signal such as a user input. Aplurality of images captured by the plurality of camera modules 140 maybe stitched based on execution of, for example, an image editing programto be implemented as a multi-FOV image.

The processor 150 may be electrically connected with at least one (e.g.,the memory 110, the display 120, the communication interface 130, thecamera module 140, or the like) of the elements of the electronic device100 and may perform control, communication, an arithmetic operation, ordata processing for the element. For example, the processor 150 mayperform image processing for a multi-FOV image which is obtained fromthe external device (e.g., the image capture device 1, the flying device2 for image capture, or the server 3) or is generated by the pluralityof camera modules 140. In this regard, the processor 150 may divide eachof images of a plurality of FOVs (e.g., an image of a first FOV 20, animage of a second FOV 30, an image of a third FOV 40, and/or the like ofFIG. 2) constituting a multi-FOV image into a plurality of frames. Theplurality of frames may be, for example, a static image and may continueat intervals (e.g., second) of a specified time to constitute an imageof a specific FOV.

In an embodiment, the processor 150 may analyze an initial frame foreach of the images of the plurality of FOVs (e.g., the image of thefirst FOV 20, the image of the second FOV 30, the image of the third FOV40, and/or the like) based on an edge filter (e.g., a Sobel filter, aPrewitt filer, or the like). For example, the processor 150 may extractat least one object based on an edge filtered on each initial frame. Theprocessor 150 may perform, for example, a machine learning algorithm(e.g., deep learning) for the at least one extracted object. In thisoperation, the processor 150 may compare an edge of a subject (e.g., alandmark or the like), which is specified from a user or is stored in adatabase of the memory 110, with an edge of an object extracted from theinitial frame. The processor 150 may specify an object, which isidentical to the edge of the subject in rate, shape, or structure by aspecified size or more.

In an embodiment, the processor 150 may extract a dynamic object withreference to a difference image between a plurality of framescorresponding to each of the images of the plurality of FOVs. Forexample, the processor 150 may compare a plurality of frames for theimage of the first FOV 20. If there is a frame, a pixel of which ischanged, the processor 150 may determine that a dynamic object appearson the image of the first FOV 20. If movement of a dynamic object (or achange rate of a pixel) is greater than or equal to a specified size (orlevel), the processor 150 may specify the dynamic object as an event.

In various embodiments, the event may be specified in response tocontrol of the user in an operation of capturing a multi-FOV image basedon the external device (e.g., the image capture device 1 or the flyingdevice 2 for image capture) or the electronic device 100. Alternatively,the event may be specified by control of the user in an editingoperation e.g., stitching) associated with a multi-FOV image.

In an embodiment, the processor 150 may store an FOV and a time range,where at least one object specified as the event appears on a multi-FOVimage, in the memory 110. Further, the processor 150 may extract atleast part of the time range as a display object (or a notification)(e.g., a highlight image) for the event. For example, if an object(e.g., a building) specified as the event has immobility (or is notmoved), the processor 150 may extract a time range, from a time when theobject initially appears to a time when a specified time elapses, in thetime range as the display object. Alternatively, if the object specifiedas the event has mobility, the processor 150 may extract a time range ofa specified size, including a time with the largest movement size of theobject, in the time range as the display object. The processor 150 maystore the extracted display object in the memory 110.

In an embodiment, the above-mentioned display object may be output onone region of an image of a specified FOV displayed on visibility of theuser and may function as a hyperlink which supports to change an imageto an FOV where an object (or an event) corresponding to the displayobject appears. In various embodiments, the display object may includeat least one of a moving image, a thumbnail image, or an icon associatedwith the event.

FIG. 4 is a drawing illustrating an example of calculating a relativelocation for objects on a multi-FOV image according to an embodiment ofthe present disclosure.

Referring to FIG. 4, a processor 150 of FIG. 3 may analyze a multi-FOVimage stored in a memory 110 of FIG. 3 to obtain a three-dimensional(3D) coordinate for each of objects 21 and 31 which appear on themulti-FOV image. The processor 150 may calculate a distance to each ofcoordinates P(x1, y1, z1) and Q(x2, y2, z2) of the objects 21 and 31with respect to a coordinate (0, 0, 0) of a center O of a peripheralregion 10 associated with the multi-FOV image. Alternatively, theprocessor 150 may calculate the shortest distance between the coordinate(0, 0, 0) of the center O of the peripheral region 10 and at least onecoordinate included in an edge of each of the objects 21 and 31. Theprocessor 150 may substitute the calculated distance information into aseries of arithmetic processes to obtain information about a relativelocation (e.g., an angle) between the objects 21 and 31 with respect tothe center O of the peripheral region 10. In an embodiment, the locationinformation may be converted into a specified time unit in connectionwith calculating a time when an output of the display object on oneregion of an image of a specific FOV is started. A description will begiven below of the location information.

In FIGS. 5 to 7 below, an image of a specific FOV displayed or output ona display region of an electronic device may be shown in the form of asingle eye (e.g., in a form where one screen is output on the displayregion) for convenience of description. Herein, the image of thespecific FOV in the form of the single eye may be changed to a form ofboth eyes (e.g., a form where the display region is divided into aplurality regions and where the same or similar screen is output on eachof the plurality of divided regions) in connection with the electronicdevice which is mounted on an HMD device or is integrated with the HMDdevice.

FIG. 5 is a drawing illustrating an image of a first FOV of a multi-FOVaccording to an embodiment of the present disclosure.

Referring to FIG. 5, a multi-FOV image stored in a memory 110 of FIG. 3may be displayed (or output) on a display 120 of an electronic device100 of FIG. 3 in response to control of a processor 150 of FIG. 3. Asplayback of the multi-FOV image is started, a user may view an image ofa specific FOV (e.g., a first FOV 20) in the multi-FOV image.

In an embodiment, the processor 150 may monitor the memory 110 in realtime or at a specified period and may identify a display object (e.g., ahighlight image) associated with the first FOV 20. For example, theprocessor 150 may identify the display object associated with the firstFOV 20 by determining whether an object (or event) associated with thedisplay object appears within a specified time range with respect to acurrent playback time 23 (e.g., 20 seconds) of the image of the firstFOV 20 (e.g., a range of +20 seconds and −4 seconds with respect to 20seconds). If the object (or event) associated with the display objectappears within the specified time range, the processor 150 may determinethe display object as a display object associated with the first FOV 20and may output the display object on at leak one region of the image ofthe first FOV 20. In this operation, the processor 150 may determine arelative direction between the first FOV 20 and the object associatedwith the display object. For example, the processor 150 may determine amutually relative direction based on a 3D coordinate of each of acentral point in the image of the first FOV 20 and the object associatedwith the display object.

In an embodiment, the processor 150 may output the display objectassociated with the first FOV 20 on a specific region in the image ofthe first FOV 20 based on information about the relative direction. Forexample, if determining that a first object 31 according to a firstdisplay object 33 associated with the first FOV 20 appears in adifferent FOV of a southwest direction with respect to the central pointof the first FOV 20, the processor 150 may output the first displayobject 33 on a region corresponding to the southwest direction amongedge regions of the image of the first FOV 20. In the same or similaroperation to this operation, if a second object 41 appears in adifferent FOV of a northwest direction from the central point of thefirst FOV 20, the processor 150 may output a second display object 43associated with the second object 41 on a northwest edge region of theimage of the first FOV 20. In various embodiments, if the first object31 and the second object 41 appear in the same or similar direction toeach other, the first display object 33 and the second display object 43may be displayed such that at least part of the first display object 33and at least part of the second display object 43 are overlapped witheach other.

In an embodiment, if the above-mentioned display object 33 or 43 isdetermined as being associated with a specific FOV except for the firstFOV 20 and is output on an image of the specific FOV, it may be outputon a region different from the above-mentioned output region (e.g., thesouthwest region or the northwest region) on the image of the first FOV20. For example, if the second display object 43 is output on one regionof an image of a specific FOV, since the relative direction isdetermined based on a central point of the specific FOV and an FOV wherethe second object 41 associated with the second display object 43appears, the relative direction may be determined as a directiondifferent from the southwest direction with respect to the central pointof the first FOV 20. Thus, the second display object 43 may be output ona region different from a southwest edge region of the image of thefirst FOV 20 among edge regions of the image of the specific FOV.

In an embodiment, direction information 35 or 45 associated with therelative direction may be included in at least one region of the firstdisplay object 33 or the second display object 43 output on one regionof the image of the first FOV 20. The direction information 35 or 45 maybe a visual object indicating a direction for an FOV where the object ofthe first display object 33 or the second display object 43 appears withrespect to the central point of the first FOV 20. In variousembodiments, the direction information 35 or 45 may include at least oneof text, an icon, or a symbol.

In various embodiments, the first display object 33 or the seconddisplay object 43 may be output with luminance (e.g., semi-transparency)of a specified level in connection with securing visibility of the imageof the first FOV 20. Further, in various embodiments, in an operation ofoutputting at least one display object on an FOV image which iscurrently being played back, the processor 150 may control an acousticdevice included in the electronic device 100 or an external device(e.g., an HMD device 4 or the like of the FIG. 1) electrically connectedwith the electronic device 100 to output a specified notification sound(or a notification).

In an embodiment, the processor 150 may output each of the first displayobject 33 and the second display object 43 at a different time on theimage of the first FOV 20. As described with reference to FIG. 4, arelative location (e.g., an angle) may be calculated between an objectwhich appears on the image of the first FOV 20 and an object whichappears in an FOV except for the first FOV 20. In an embodiment, theprocessor 150 may calculate a previous display time of a display objectbased on location information between objects. The previous display timemeans that an object associated with a display object (e.g., a displayobject corresponding to an FOV different from the first FOV 20) appearsin an FOV except for the first FOV 20 if a time elapses after thedisplay object is output. In this regard, it may be assumed that anangle between an object 21 which appears on the image of the first FOV20 and the first object 31 associated with the first display object 33of an FOV different from the first FOV 20 is 30 degrees. As anotherassumption, it may be assumed that the first object 31 associated withthe first display object 33 appears on an image of an FOV different fromthe first FOV 20 at 30 seconds which are a time within a time range(e.g., 16 seconds to 40 seconds) associated with the current playbacktime 23 (e.g., 20 seconds) of the image of the first FOV 20. In thiscase, the processor 150 may calculate a previous display time as 3seconds by applying 1 second per 10 degrees to 30 degrees and may outputthe first display object 33 on one region of the image of the first FOV20 at 27 seconds which are a time before the previous display time(e.g., 3 seconds) from 30 seconds which are a time when the first object31 associated with the first display object 33 appears. The 27 secondsmay be after 7 seconds with respect to the current playback time 23(e.g., 20 seconds) of the image of the first FOV 20. In an embodiment,an object, such as the second object 41 (e.g., the building) associatedwith the second display object 43, which has no mobility (or hasimmobility), may continuously appear during a playback time of amulti-FOV image in an FOV different from the first FOV 20. In this case,the processor 150 may output the second display object 43 on one regionof the image of the first FOV 20 from a playback start time of the imageof the first FOV 20. In various embodiments, at least one display objectoutput on the image of the first FOV 20 may disappear after a specifiedtime elapses from starting displaying the display object or maydisappear in response to an input (e.g., a touch) of a user, provided toat least one point of the display object (e.g., reference numeral 47 ofthe second display object 43).

In an embodiment, the above-mentioned previous display time 37 may beincluded in at least one region of the first display object 33 or thesecond display object 43. With reference to the first display object 33,for example, the previous display time 37 may be provided concurrentlywith outputting the first display object 33 at a time (e.g., 27 seconds)when a time (e.g., the 7 seconds) calculated through a series ofarithmetic operations elapses from the current playback time 23 (e.g.,20 seconds) of the image of the first FOV 20.

In an embodiment, the specified time range (e.g., 16 seconds to 40seconds) with respect to the current playback time 23 of the image ofthe first FOV 20 may be changed in response to playback of the image ofthe first FOV 20. Thus, a display object of an FOV different from thefirst FOV 20 met in a new time range may be further output.Alternatively, the previous display time 37 may be updated. For example,if the current playback time 23 of the image of the first FOV 20 ischanged (e.g., increased) by 1 second, the previous display time 37 mayalso be changed (e.g., decreased) by 1 second. Thus, a state where theprevious display time 37 is indicated with a negative number may referto a state where appearance of an object associated with the displayobject is completed in an FOV different from the first FOV 20 (or astate where a time elapses from the completion of the appearance). Invarious embodiments, if the previous display time 37 is indicated with apositive number, the processor 150 may process a display objectincluding the previous display time 37 using a first display effect(e.g., display the display object in a color). On the other hand, if theprevious display time 37 is indicated with a negative number, a displayobject including the previous display time 37 may be processed using asecond display effect (e.g., display the display object in black andwhite) by control of the processor 150.

In an embodiment, if a user provides an input (e.g., a touch input usinghis or her body or touch pen) to at least one region of theabove-mentioned display object, the processor 150 may change an FOV of amulti-FOV image. For example, if the user input is provided to the firstdisplay object 33 output on one region of the image of the first FOV 20,the processor 150 may change the image of the first FOV 20 to an imageof an FOV corresponding to the first display object 22. In thisoperation, the processor 150 may store information about the image ofthe first FOV 20 before the change (e.g., FOV information and appearancetime information of the object 21 which appears on the image of thefirst FOV 20).

FIG. 6 is a drawing illustrating an image of a second FOV of a multi-FOVaccording to an embodiment of the present disclosure.

Referring to FIG. 6, a processor 150 of FIG. 3 may receive a user inputprovided to at least one region of a specific display object (e.g., afirst display object 33 of FIG. 5) and may control a display 120 tochange an image of a first FOV 20 of FIG. 5, displayed on visibility ofa user (or output on the display 120), to an image of an FOV (e.g., asecond FOV 30) corresponding to the first display object 33. Thus, theimage of the second FOV 30 may be displayed (or output) on the display120, and at least one object 31 which appears in the second FOV 30 maybe displayed. In various embodiments, the processor 150 may control thedisplay 120 to display an image of at least one FOV, which existsbetween, for example, the first FOV 20 and the second FOV 30 (or isaccompanied in a process of changing the first FOV 20 to the second FOV30), at a specified speed (e.g., hyperlapse) in the operation ofchanging the image of the first FOV 20 to the image of the second FOV30.

In an embodiment, if changed to the image of the second FOV 30, theprocessor 150 may access a memory 110 of FIG. 3 and may identify adisplay object associated with an FOV different from the second FOV 30.The processor 150 may determine whether an object associated with theidentified display object appears within a specified time range withrespect to a current playback time 39 of the image of the second FOV 30(e.g., a range of +20 seconds and −4 seconds with respect to the currentplayback time 39). If the object appears within the specified timerange, the processor 150 may output a display object (e.g., a displayobject 51) corresponding to the object on at least one region of theimage of the second FOV 30.

In an embodiment, the processor 150 may display (or output) informationabout an image of a previous FOV (e.g., the first FOV 20), stored in thememory 110, on at least a partial region of the image of the second FOV30 when changed to the second FOV 30. For example, the processor 150 maydisplay the image of the first FOV 20, which is the image of theprevious FOV as an object (e.g., a return object 27) in the form ofbeing the same or similar to the above-mentioned display object. If aninput by a user (e.g., a touch input using his or her body or touch pen)is provided to at least one region of the return object 27, the image ofthe second FOV 30 which is being displayed (or output) may be changed(or returned) to the image of the first FOV 20.

FIG. 7 is a drawing illustrating an image of a first FOV of a multi-FOVaccording to another embodiment of the present disclosure. An image of afirst FOV 20 shown in FIG. 7 may be operatively the same or similar toan image of a first FOV described with reference to FIG. 5. Hereinafter,a description will be given of elements different from the image of thefirst FOV of FIG. 5.

Referring to FIG. 7, for example, a development image 50 of a multi-FOVimage may be scaled down and displayed on at least one region of theimage of the first FOV 20. The development image 50 may include content(e.g., an icon) associated with at least one object which appears on amulti-FOV image. In various embodiments, a path guide line 52 based on arelative time when at least one object appears on a multi-FOV image maybe displayed on the development image 50.

In an embodiment, for example, an interface 60 for supporting to playback a separate image file (e.g., a single FOV image file, a multi-FOVimage file, or the like) different from a multi-FOV image file which iscurrently being played back may be displayed on at least one region ofthe image of the first FOV 20. In this regard, in one embodiment, in anoperation of downloading (or streaming) an image file (or image data)from an external device (e.g., an image capture device 1, a flyingdevice 2 for image capture, or a server 3 of FIG. 1), for example, aprocessor 150 of FIG. 3 may obtain image capture location information ofthe external device for the image file. Alternatively, if an electronicdevice 100 captures an image, the processor 150 may obtain image capturelocation information of the electronic device 100 based on a globalpositioning system (GPS). The image capture location information may bestored in a memory 110 of FIG. 3 together with the image file.

In an operation of controlling playback of a multi-FOV image, theprocessor 150 may verify image capture location information about themulti-FOV image file and may compare the image capture locationinformation with at least one image capture location information storedin the memory 110. In an embodiment, if at least one of image filesstored in the memory 110 has image capture location information in aspecified distance range with respect to an image capture location of amulti-FOV image file to be currently played back, the processor 150 mayoutput the interface 60 (e.g., an interface for supporting to play backan image file having a similar image capture location to that of amulti-FOV image which is being played back) on at least one region of amulti-FOV image (e.g., the image of the first FOV 20) started to beplayed back. In various embodiments, the interface 60 may include theabove-mentioned hyperlink function.

In various embodiments, if capturing a multi-FOV image in real timebased on the electronic device 100 including a plurality of cameramodules 140 of FIG. 3, the processor 150 may access the memory 110 andmay identify an image file captured within a specified range withrespect to an image capture location of the electronic device 100 basedon the GPS. If at least one image file having the same or similar imagecapture location information to a location of the electronic device 100which is capturing an image in real time is identified, the processor150 may display an interface for supporting to play back the identifiedimage file (or change to the identified image file) on at least oneregion of an image which is being captured in real time.

For example, in connection with the above-mentioned details, a user maypark a vehicle on a specified area in a wide parking lot and may capturea first multi-FOV image for a parking area. In this operation, thevehicle may be specified as an event in response to control of the user.The captured first multi-FOV image may be stored in the memory 110 ofthe electronic device 100. Thereafter, if the user captures a secondmulti-FOV image in the parking lot, the processor 150 may identify afile for the first multi-FOV image captured in a similar place based oncurrent location information of the electronic device 100 and maydisplay an interface associated with playing back the first multi-FOVimage file on at least one region of the second multi-FOV image which isbeing captured (or changing to the first multi-FOV image file). Thus,the user may easily search for an area in which the vehicle is parkedwith reference to the first multi-FOV image.

As another example, the support to play back another image file (or thesupport to change to the other image file) may be applied to a pluralityof image capture devices. In this regard, there may be a plurality ofimage capture devices, each of which captures an image for a specificFOV in the same or similar location. The plurality of image capturedevices may include a network established between, for example, a server(e.g., a server 3 of FIG. 1) and the image capture devices. An image ofa specific FOV, captured by each of the plurality of image capturedevices, may be transmitted to the server over the network at aspecified period or in real time. A first image capture device among theplurality of image capture devices may request the server to transmit anFOV image captured by another image capture device based on the network.In this case, the server may transmit FOV image files of image capturedevices adjacent to the first image capture device to the first imagecapture device based on image capture location information of theplurality of image capture devices. A process of the first image capturedevice may output an interface for supporting to play back an image fileof at least one FOV, transmitted from the server, on at least one regionof an image of a specific FOV, which is being played back on the firstimage capture device (or change to the image file of the at least oneFOV).

An electronic device according to various embodiments may include amemory configured to store an image of a multi-FOV including an image ofa first FOV and an image of a second FOV, a display configured to outputthe image of the multi-FOV, and a processor configured to beelectrically connected with the memory and the display.

According to various embodiments, the processor may control to outputthe image of the first FOV on the display, may verify at least one eventwhich meets a specified condition from the image of the second FOV, andmay control to provide a notification corresponding to the event inconnection with the image of the first FOV, the image being output onthe display.

According to various embodiments, the processor may verify at least oneevent, which occurs within a specified time range with respect to acurrent playback time of the image of the first FOV, as the event.

According to various embodiments, the processor may control to changethe image of the first FOV, output on the display, to at least part ofthe image of the second FOV in response to a user input on thenotification.

According to various embodiments, the processor may control to provideanother notification for supporting a change to the image of the firstFOV, in connection with the at least part of the image of the secondFOV.

According to various embodiments, the processor may specify the changeto the image of the first FOV as a return event.

According to various embodiments, when changing to the image of thefirst FOV or the image of the second FOV, the processor may control toprovide at least part of the image of the multi-FOV at a specified speedin the image change.

According to various embodiments, the processor may calculate a relativelocation of the event with respect to the first FOV and may calculate atime when a notification corresponding to the event is provided, inconnection with the relative location.

According to various embodiments, the processor may specify at least oneof an object having mobility of a specified size or more, included inthe image of the multi-FOV, or an object which is identical to aspecified subject by a specified size or more as the event.

According to various embodiments, the processor may control to provide arange, from a time when the event initially occurs to a time when aspecified time elapses, in a time range where the event occurs on theimage of the multi-FOV as a notification corresponding to the event.

According to various embodiments, the processor may control to provideinformation about a time interval between a time when the providing ofthe notification is started and a time when the event occurs, as atleast part of the notification corresponding to the event.

According to various embodiments, the processor may control to provideinformation about a relative direction between the first time and thesecond time associated with the event, as at least part of thenotification corresponding to the event.

According to various embodiments, the processor may control to process afirst notification corresponding to an event which occurs before acurrent playback time of the image of the first FOV and a secondnotification corresponding to an event which will occur after thecurrent playback time using different effects.

According to various embodiments, the processor may generate adevelopment image corresponding to the multi-FOV, may control to outputthe development image on at least a partial region of the display, andmay include at least one information associated with the event on thedevelopment image.

According to various embodiments, the electronic device may beconfigured to be mountable on a HMD device.

According to various embodiments, the electronic device may be referredto as a portable communication device.

According to various embodiments, the portable communication device mayinclude a communication module, a memory, and a processor configured tobe electrically connected with the communication module and the memory.

According to various embodiments, the processor may verify a multi-FOVimage stored in the memory, may control to output a first imagecorresponding to a first FOV of the multi-FOV image, may control toprovide a notification indicating at least part of a second imagecorresponding to a second FOV of the multi-FOV image in connection withoutputting the first image, may control to obtain a user input on thenotification, and may control to output at least part of the secondimage in response to the user input.

According to various embodiments, if the second image includes at leastone event which occurs within a specified time range with respect to acurrent playback time of the first image, the processor may control toprovide a range, from a time when the event initially occurs to a timewhen a specified time elapses, in a time range when the event occurs onthe second image as the notification.

FIG. 8 is a flowchart illustrating a method for controlling a multi-FOVin an electronic device according to an embodiment of the presentdisclosure.

Referring to FIG. 8, in operation 801, a processor (e.g., a processor150 of FIG. 3) an electronic device (e.g., an electronic device 100 ofFIG. 3) may perform image processing for a multi-FOV image which isobtained from an external device (e.g., an image capture device 1, aflying device 2 for image capture, or a server 3 of FIG. 1) and iscaptured by the electronic device. In this operation, the processor mayextract at least one object included in the multi-FOV image.

In operation 803, the processor may specify at least one object havingsimilarity of a specified size or more with at least one subject, whichis specified from a user or is stored in a database of a memory (e.g., amemory 110 of FIG. 3), (e.g., similarity in which an edge of the objectand the edge of the subject are the same as each other in rate, shape,or structure by a specified size or more) as an event. Alternatively,the processor may specify at least one dynamic object, which moves onthe multi-FOV image by a specified size or more, as an event. Theprocessor may store an FOV and a time range where the at least oneobject specified as the event appears on the multi-FOV image in thememory.

In operation 805, the processor may extract at least part of a timerange in which the at least one specified event (or object) appears onthe multi-FOV image as a display object (e.g., a highlight image) andmay store the extracted display object in the memory, For example, ifthe object (e.g., a building) specified as the event has immobility (oris not moved), the processor may extract a range, from a time when anobject initially appears to a time when a specified time elapses, in thetime range as a display object. Alternatively, if the object specifiedas the event has mobility (or is a dynamic object), the processor mayextract a time range of a specified size, including a time with thelargest movement size of an object, in the time range as a displayobject.

In operation 807, the processor may monitor the memory and may identifya display object corresponding to an FOV different from an image of afirst FOV, which is currently being played back on a display (e.g., adisplay 120 of FIG. 3). The processor may output at least one displayobject, associated with an event (or object) which appears within a timerange (e.g., +20 seconds and −4 seconds) with respect to a currentplayback time of the image of the first FOV, among the identifieddisplay objects on one region of the image of the first FOV. In thisoperation, the processor may calculate a previous display time of adisplay object based on information about a relative location (e.g., anangle) between an object which appears in the first FOV and an objectwhich appears in another FOV and may reflect the calculated previousdisplay time in outputting the display object.

In operation 809, if an input of a user (e.g., a touch input using hisor her body or touch pen) is provided to any one of the at least onedisplay object output on the at least one region of the image of thefirst FOV, the processor may change the image of the first FOV, which iscurrently being played back, to an FOV image associated with the displayobject to which the input is provided.

A method for controlling a multi-FOV image in an electronic deviceaccording to various embodiments may include outputting an image of afirst FOV of a multi-FOV image, verifying at least one event which meetsa specified condition from an image of a second FOV of the multi-FOVimage, and providing a notification corresponding to the event inconnection with the image of the first FOV.

According to various embodiments, the method may further includechanging the image of the first FOV to at least part of the image of thesecond FOV in response to a user input on the notification.

According to various embodiments, the providing of the notification mayinclude providing a range, from a time when the event initially occursto a time when a specified time elapses, in a time range when the eventoccurs on the multi-FOV image as a notification corresponding to theevent.

According to various embodiments, the providing of the notification mayinclude calculating a relative location of the event with respect to thefirst FOV and calculating a time when the notification corresponding tothe event is provided, in connection with the relative location.

FIG. 9 is a block diagram illustrating a configuration of an electronicdevice in a network environment according to an embodiment of thepresent disclosure.

Referring to FIG. 9, under the network environment 900, the electronicdevice 901 (e.g., an electronic device 100 of FIG. 3) may communicatewith an electronic device 902 through local wireless communication 998or may communication with an electronic device 904 or a server 908through a network 999. According an embodiment, the electronic device901 may communicate with the electronic device 904 through the server908.

According to an embodiment, the electronic device 901 may include a bus910, a processor 920 (e.g., at least one processor 150 of FIG. 3) amemory 930, an input device 950 (e.g., a micro-phone or a mouse), adisplay 960, an audio module 970, a sensor module 976, an interface 977,a haptic module 979, a camera module 980, a power management module 988,a battery 989, a communication module 990, and a subscriberidentification module 996. According to an embodiment, the electronicdevice 901 may not include at least one (e.g., the display 960 or thecamera module 980) of the above-described elements or may furtherinclude other element(s).

For example, the bus 910 may interconnect the above-described elements920 to 990 and may include a circuit for conveying signals (e.g., acontrol message or data) between the above-described elements. Theprocessor 920 may include one or more of a central processing unit(CPU), an application processor (application), a graphic processing unit(GPU), a camera image signal processor (ISP) of a camera or acommunication processor (CP). According to an embodiment, the processor920 may be implemented with a system on chip (Soc) or a system inpackage (SiP). For example, the processor 920 may drive an operatingsystem (OS) or an application to control at least one of another element(e.g., hardware or software element) connected to the processor 920 andmay process and compute various data. The processor 920 may load aninstruction or data, which is received from at least one of otherelements (e.g., the communication module 990), into a nonvolatile memory932 to process the instruction or data and may store the process resultdata into the nonvolatile memory 934.

The memory 930 may include, for example, a volatile memory 932 or anonvolatile memory 934. The volatile memory 932 may include, forexample, a random access memory (RAM) (e.g., a dynamic random accessmemory (DRAM), a static RAM (SRAM), or a synchronous dynamic RAM(SDRAM)). The nonvolatile memory 934 may include, for example, one timeprogrammable read-only memory (OTPROM), programmable read-only memory(PROM), an erasable programmable read-only memory (EPROM), anelectrically erasable programmable read-only memory (EEPROM), a maskROM, a flash ROM, a flash memory, a hard drive, or a solid-state drive(SSD). In addition, the nonvolatile memory 934 may be configured in theform of an internal memory 936 or the form of an external memory 938which is available through connection only if necessary, according tothe connection forms of the electronic device 901. The external memory938 may further include a flash drive such as compact flash (CF), securedigital (SD), micro secure digital (micro-SD), mini secure digital(mini-SD), extreme digital (xD), a multimedia card (MMC), or a memorystick. The external memory 938 may be operatively or physicallyconnected with the electronic device 901 in a wired manner (e.g., acable or a universal serial bus (USB)) or a wireless (e.g.,bluetooth(BT)) manner.

For example, the memory 930 may store, for example, at least onedifferent software element, such as an instruction or data associatedwith the program 940, of the electronic device 901. The program 940 mayinclude, for example, a kernel 941, a library 943, an applicationframework 945 or an application program (interchangeably, “application”)947.

The input device 950 may include a microphone, a mouse, or a keyboard.According to an embodiment, the keyboard may include a keyboardphysically connected or a keyboard virtually displayed through thedisplay 960.

The display 960 may include a display, a hologram device or a projector,and a control circuit to control a relevant device. The screen mayinclude, for example, a liquid crystal display (LCD), a light emittingdiode (LED) display, an organic LED (OLED) display, a plastic OLED(POLED), a microelectromechanical systems (MEMS) display, or anelectronic paper display. According to an embodiment, the display may beflexibly, transparently, or wearably implemented. The display mayinclude a touch circuitry, which is able to detect a user's touch inputsuch as a gesture input, a proximity input, or a hovering input or apressure sensor (interchangeably, a force sensor) which is able tomeasure the intensity of the pressure by the touch. The touch circuit orthe pressure sensor may be implemented integrally with the display ormay be implemented with at least one sensor separately from the display.The hologram device may show a stereoscopic image in a space usinginterference of light. The projector may project light onto a screen todisplay an image. The screen may be located inside or outside theelectronic device 901.

The audio module 970 may convert, for example, from a sound into anelectrical signal or from an electrical signal into the sound. Accordingto an embodiment, the audio module 970 may acquire sound through theinput device 950 (e.g., a microphone) or may output sound through anoutput device (not illustrated) (e.g., a speaker or a receiver) includedin the electronic device 901, an external electronic device (e.g., theelectronic device 902 (e.g., a wireless speaker or a wirelessheadphone)) or an electronic device 906 (e.g., a wired speaker or awired headphone)connected with the electronic device 901

The sensor module 976 may measure or detect, for example, an internaloperating state (e.g., power or temperature) or an external environmentstate an altitude, a humidity, or brightness) of the electronic device901 to generate an electrical signal or a data value corresponding tothe information of the measured state or the detected state. The sensormodule 976 may include, for example, at least one of a gesture sensor, agyro sensor, a barometric pressure sensor, a magnetic sensor, anacceleration sensor, a grip sensor, a proximity sensor, a color sensor(e.g., a red, green, blue (RGB) sensor), an infrared sensor, a biometricsensor (e.g., an iris sensor, a fingerprint senor, a heartbeat ratemonitoring (FIRM) sensor, an e-nose sensor, an electromyography (EMG)sensor, an electroencephalogram (EEG) sensor, an electrocardiogram (ECG)sensor, a temperature sensor, a humidity sensor, an illuminance sensoror an UV sensor. The sensor module 976 may further include a controlcircuit for controlling at least one or more sensors included therein.According to an embodiment, the sensor module 976 may be controlled byusing the processor 920 or a processor (e.g., a sensor hub) separatefrom the processor 920. In the case that the separate processor (e.g., asensor hub) is used, while the processor 920 is a sleep state, theseparate processor may operate without awakening the processor 920 tocontrol at least a portion of the operation or the state of the sensormodule 976.

According to an embodiment, the interface 977 may include a highdefinition multimedia interface (HDMI), a universal serial bus (USB), anoptical interface, a recommended standard 232 (RS-232), a D-subminiature(D-sub), a mobile high-definition link (MHL) interface, a SDcard/MMC(multi-media card) interface, or an audio interface. A connector978 may physically connect the electronic device 901 and the electronicdevice 906. According to an embodiment, the connector 978 may include,for example, an USB connector, an SD card/MMC connector, or an audioconnector (e.g., a headphone connector),

The haptic module 979 may convert an electrical signal into mechanicalstimulation (e.g., vibration or motion) or into electrical stimulation.For example, the haptic module 979 may apply tactile or kinestheticstimulation to a user. The haptic module 979 may include, for example, amotor, a piezoelectric element, or an electric stimulator.

The camera module 980 may capture, for example, a still image and amoving picture. According to an embodiment, the camera module 980 mayinclude at least one lens (e.g., a wide-angle lens and a telephoto lens,or a front lens and a rear lens), an image sensor, an image signalprocessor (ISP), or a flash (e.g., a light emitting diode or a xenonlamp).

The power management module 988, which is to manage the power of theelectronic device 901, may constitute at least a portion of a powermanagement integrated circuit (PMIC).

The battery 989 may include a primary cell, a secondary cell, or a fuelcell and may be recharged by an external power source to supply power atleast one element of the electronic device 901.

The communication module 990 may establish a communication channelbetween the electronic device 901 and an external device (e.g., thefirst external electronic device 902, the second external electronicdevice 904, or the server 908). The communication module 990 may supportwired communication or wireless communication through the establishedcommunication channel. According to an embodiment, the communicationmodule 990 may include a wireless communication module 992 or a wiredcommunication module 994. The communication module 990 may communicatewith the external device (e.g., the first external electronic device902, the second external electronic device 904 or the server 908)through a first network 998 (e.g. a wireless local area network (LAN)such as Bluetooth (BT) or infrared data association (IrDA)) or a secondnetwork 999 (e.g., a wireless wide area network such as a cellularnetwork) through a relevant module among the wireless communicationmodule 992 or the wired communication module 994.

The wireless communication module 992 may support, for example, cellularcommunication, local wireless communication, global navigation satellitesystem (GNSS) communication. The cellular communication may include, forexample, long-term evolution (LTE), LTE Advance (LTE-A), code divisionmultiple access (CMA), wideband CDMA (WCDMA), universal mobiletelecommunications system (UMTS), wireless broadband (WiBro), or globalsystem for mobile communications (GSM). The local wireless communicationmay include wireless fidelity (Wi-Fi), WiFi Direct, light fidelity,Bluetooth, Bluetooth low energy (BLE), Zigbee, near field communication(NEC), magnetic secure transmission (MST), radio frequency (RF), or abody area network (BAN). The GNSS may include at least one of a globalpositioning system (GPS), a global navigation satellite system(Glonass), Beidou Navigation Satellite System (Beidou) or Galileo, theEuropean global satellite-based navigation system, or the like. In thepresent disclosure, “GPS” and “GNSS” may be interchangeably used.

According to an embodiment, when the wireless communication module 992supports cellar communication, the wireless communication module 992may, for example, identify or authenticate the electronic device 901within a communication network using the subscriber identificationmodule (e.g., a SIM card) 996. According to an embodiment, the wirelesscommunication module 992 may include the processor 920 (e.g., anapplication processor (AP) and a separate communication processor (CP).In this case, the communication processor may perform at least a portionof functions associated with at least one of elements 910 to 996 of theelectronic device 901 in substitute for the processor 920 when theprocessor 920 is in an inactive (sleep) state, and together with theprocessor 920 when the processor 920 is in an active state. According toan embodiment, the wireless communication module 992 may include aplurality of communication modules, each supporting only a relevantcommunication scheme among cellular communication, short-range wirelesscommunication, or a GNSS communication scheme.

The wired communication module 994 may include, for example, include alocal area network (LAN) service, a power line communication, or a plainold telephone service (POTS).

For example, the first network 998 may employ, for example, WiFi director Bluetooth for transmitting or receiving instructions or data throughwireless direct connection between the electronic device 901 and thefirst external electronic device 902. The second network 999 may includea telecommunication network (e.g., a computer network such as a LAN or aWAN, the Internet or a telephone network) for transmitting or receivinginstructions or data between the electronic device 901 and the secondelectronic device 904.

According to embodiments, the instructions or the data may betransmitted or received between the electronic device 901 and the secondexternal electronic device 904 through the server 908 connected with thesecond network. Each of the external first and second externalelectronic devices 902 and 904 may be a device of which the type isdifferent from or the same as that of the electronic device 901.According to various embodiments, all or a part of operations that theelectronic device (901 will perform may be executed by another or aplurality of electronic devices (e.g., the electronic devices 902 and904 or the server 908. According to an embodiment, in the case that theelectronic device 901 executes any function or service automatically orin response to a request, the electronic device 901 may not perform thefunction or the service internally, but may alternatively oradditionally transmit requests for at least a part of a functionassociated with the electronic device 901 to another device (e.g., theelectronic device 902 or 904 or the server 908). The another electronicdevice (e.g., the electronic device 902 or 904 or the server 908) mayexecute the requested function or additional function and may transmitthe execution result to the electronic device 901. The electronic device901 may provide the requested function or service using the receivedresult or may additionally process the received result to provide therequested function or service. To this end, for example, cloudcomputing, distributed computing, or client-server computing may beused.

The terms of a singular form may include plural forms unless otherwisespecified. In the present disclosure, the expressions “A or B”, “atleast one of A and/or B”, “A, B, or C”, or at least one of “A, B and/orC” may include all possible combinations of one or more of theassociated listed items. The terms such as “first”, “second”, and thelike used herein may refer to various elements regardless of the orderand/or priority of the elements and may be used to distinguish anelement from another element, not to limit the elements. It will beunderstood that when an element (e.g., a first element) is referred toas being “(operatively or communicatively) coupled with/to” or“connected to” another element (e.g., a second element), the element maybe directly coupled with/to or connected to the another element or anintervening element (e.g., a third element) may be present therebetween.

In the present disclosure, according to the situation, the expression“adapted to or configured to” used herein may be interchangeably usedwith , for example, the expression “suitable for”, “having the capacityto”, “changed to”, “made to”, “capable of”, or “designed to” “adaptedto”, “made to”, or “capable of”. Under a certain situation, theexpression “a device configured to” may mean that the device is “capableof” operating together with another device or other components. Forexample, a “processor configured to (or adapted to) perform A, B, and C”may mean a dedicated processor (e.g., an embedded processor) forperforming a corresponding operation or a generic-purpose processor(e.g., a central processing unit (CPU) or an application processor)which may perform corresponding operations by executing one or moresoftware programs which are stored in a memory device (e.g. 930).

The term “module” as used in the present disclosure may represent, forexample, a unit including one or more combinations of hardware, softwareand firmware. The term “module” may be interchangeably used with theterms “unit”, “logic”, “logical block”, “component” and “circuit”. The“module” may be a minimum unit of an integrated component or may be apart thereof. The “module” may be a minimum unit for performing one ormore functions or a part thereof. The “module” may be implementedmechanically or electronically. For example, the “module” may include atleast one of an application-specific IC (ASIC) chip, afield-programmable gate array (FPGA), and a programmable-logic devicefor performing some operations, which are known or will be developed.

At least a part of an apparatus (e.g., modules or functions thereof) ora method (e.g., operations) according to an embodiment of the presentdisclosure may be, for example, implemented by instructions stored in acomputer-readable storage media in the form of a program module. Theinstruction, when executed by a processor 920, may cause the one or moreprocessors to perform a function corresponding to the instruction. Thecomputer-readable storage media, for example, may be the memory 930.

A computer-readable recording medium may include a hard disk, a floppydisk, a magnetic media (e.g., a magnetic tape), an optical media (e.g.,a compact disc read only memory (CD-ROM) and a digital versatile disc(DVD), a magneto-optical media (e.g., a floptical disk)), and hardwaredevices (e.g., a read only memory (ROM), a random access memory (RAM),or a flash memory). Also, a program instruction may include not only amechanical code such as generated by a compiler but also a high-levellanguage code executable on a computer using an interpreter. The abovehardware unit may be configured to operate via one or more softwaremodules for performing an operation according to an embodiment of thepresent disclosure, and vice versa.

A module or a program module according to an embodiment of the presentdisclosure may include at least one of the above elements, or a part ofthe above elements may be omitted, or additional other elements may befurther included. Operations performed by a module, a program module, orother elements may be executed sequentially, in parallel, repeatedly, orin a heuristic method. In addition, some operations may be executed indifferent sequences or may be omitted. Alternatively, other operationsmay be added.

While the present disclosure has been shown and described with referenceto various embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the present disclosure asdefined by the appended claims and their equivalents.

What is claimed is:
 1. An electronic device comprising: a memoryconfigured to store an image of a multi-field of view (multi-FOV)including an image of a first FOV and an image of a second FOV; adisplay configured to output the image of the multi-FOV; and a processorconfigured to be electrically connected with the memory and the display,wherein the process is configured to: control to output the image of thefirst FOV on the display; verify at least one event which meets acondition from the image of the second FOV; and control to provide anotification corresponding to the event in connection with the image ofthe first FOV, the image being output on the display.
 2. The electronicdevice of claim 1, wherein the process is configured to: verify at leastone event, which occurs within a time range with respect to a currentplayback time of the image of the first FOV, as the event.
 3. Theelectronic device of claim 1, wherein the process is configured to:control to change the image of the first FOV, output on the display, toat least part of the image of the second FOV in response to a user inputon the notification.
 4. The electronic device of claim 3, wherein theprocess is configured to: control to provide another notification forsupporting a change to the image of the first FOV, in connection withthe at least part of the image of the second FOV.
 5. The electronicdevice of claim 4, wherein the process is configured to: specify thechange to the image of the first FOV as a return event.
 6. Theelectronic device of claim 4, wherein the process is configured to: whenchanging to the image of the first FOV or the image of the second FOV,control to provide at least part of the image of the multi-FOV at aspeed in the image change.
 7. The electronic device of claim 1, whereinthe process is configured to: calculate a relative location of the eventwith respect to the first FOV; and calculate a time when a notificationcorresponding to the event is provided, in connection with the relativelocation.
 8. The electronic device of claim 1, wherein the process isconfigured to: specify at least one of an object having mobility of asize or more, included in the image of the multi-FOV, or an object whichis identical to a subject by a size or more as the event.
 9. Theelectronic device of claim 1, wherein the process is configured to:control to provide a range, from a time when the event initially occursto a time when a time elapses, in a time range where the event occurs onthe image of the multi-FOV as the notification corresponding to theevent.
 10. The electronic device of claim 1, wherein the process isconfigured to: control to provide information about a time intervalbetween a time when the providing of the notification is started and atime when the event occurs, as at least part of the notificationcorresponding to the event.
 11. The electronic device of claim 1,wherein the process is configured to: control to provide informationabout a relative direction between the first time and the second timeassociated with the event, as at least part of the notificationcorresponding to the event.
 12. The electronic device of claim 1,wherein the process is configured to: control to process a firstnotification corresponding to an event which occurs before a currentplayback time of the image of the first FOV and a second notificationcorresponding to an event which will occur after the current playbacktime using different effects.
 13. The electronic device of claim 1,wherein the process is configured to: generate a development imagecorresponding to the multi-FOV; control to output the development imageon at least a partial region of the display; and include at least oneinformation associated with the event on the development image.
 14. Theelectronic device of claim 1, wherein the electronic device isconfigured to be mountable on a head mounted display (HMD) device.
 15. Amethod for controlling a multi field of view (multi-FOV) image in anelectronic device, the method comprising: outputting an image of a firstFOV of a multi-FOV image; verifying at least one event which meets acondition from an image of a second FOV of the multi-FOV image; andproviding a notification corresponding to the event in connection withthe image of the first FOV.
 16. The method of claim 15, furthercomprising: changing the image of the first FOV to at least part of theimage of the second FOV in response to a user input on the notification.17. The method of claim 15, wherein the providing of the notificationcomprises: providing a range, from a time when the event initiallyoccurs to a time when a time elapses, in a time range when the eventoccurs on the multi-FOV image as the notification corresponding to theevent.
 18. The method of claim 15, wherein the providing of thenotification comprises: calculating a relative location of the eventwith respect to the first FOV; and calculating a time when thenotification corresponding to the event is provided, in connection withthe relative location.
 19. A portable communication device comprising: acommunication module; a memory; and a processor configured to beelectrically connected with the communication module and the memory,wherein the processor is configured to: verify a multi field of view(multi-FOV) image stored in the memory; control to output a first imagecorresponding to a first FOV of the multi-FOV image; control to providea notification indicating at least part of a second image correspondingto a second. FOV of the multi-FOV image in connection with outputtingthe first image; control to obtain a user input on the notification; andcontrol to output at least part of the second image in response to theuser input.
 20. The portable communication device of claim 19, whereinthe processor is configured to: if the second image includes at leastone event which occurs within a time range with respect to a currentplayback time of the first image, control to provide a range, from atime when the event initially occurs to a time when a time elapses, in atime range when the event occurs on the second image as thenotification.